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Consider a noisy channel which acts as a high-pass filter on the pulses 
used for transmitting digital data in binary form. To combat the degrada- 
tion of information in the channel, the pulses are detected and regenerated 
at certain points with the aid of a binary pulse regenerator with dc restora- 
tion. This device achieves complete restoration in the absence of noise. 

In this paper, we give a procedure for evaluating the limiting proba- 
bilities (after lengthy operation) of error patterns for a single dc restorer 
in the presence of independent, additive noise. The procedure is based on 
the observation that for the particular restorer in question, the effective 
noise in the restorer is the sum of the present noise and the accumulated 
noise. The latter may be described by a Markovian process. 

I. INTRODUCTION 

In this paper, we consider a binary pulse regenerator with dc restora- 
tion (Fig. 1). This system has the property that in the absence of noise 
it functions error-free. To evaluate the performance of the system, one 
would like to know the probability of occurrence for an arbitrary error 
pattern when noise is introduced. This is highly desirable especially if 
the information coding places high penalty on certain error patterns. 
It will be shown in this paper that the limiting probability of any error 
burst can be computed by an iterative procedure. The mathematical 
theory justifying the validity of the procedure is somewhat involved 
and will be given in a separate paper on Random Walk in Compact 
Metric Space. 1 

II. THE SYSTEM 

Our considerations apply to the data transmission system represented 
by the block diagram given in Fig. 1 . The input sequence dk of random 
± 1 impulses goes through a high-pass filter. The output of this filter is 
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Fig. 1 — Binary pulse regenerator with low-frequency restoration. 



sampled synchronously with the impulse train input to yield 8*. It is 
assumed that the output is contaminated by independent noise n*. A 
slicer triggering ±1 impulses b* is used for regeneration of pulses. There 
is a low-pass filter in the feedback loop followed by a sample r which is 
also synchronized with the input sequence. In the block diagram G and 
H represent the filters followed by the samplers. 

G is a discrete high-pass and H is a discrete low-pass linear filter. 
S is assumed to be an ideal slicer discriminating between positive and 
negative voltage levels. Thus, we have the system equations 



s k 



t = 2 Oh-idi k = 0,1, 



(1) 



Ck 



= E fa-fa k = 0,1, 



(2) 



and 



b k = sgn {n k + c k + s k } 



(3) 



where sgn x = 1 if x ^ and sgn x — —1 if x < 0, and g%{hi) is the 
impulse response of the filter G(H) at time i. As to the niters G and H, 
it is assumed that 



(0 

(*') 

(hi) 



h = 0, <7o > 

hi + g 4 = if i 9*0 



> gi = rg^ for 



> 2 



where < r < 1. The interpretation of (i-iii) is as follows: (i) There is 
unit time delay in the feedback loop, (ii) The filter H is chosen to 
cancel the tails of the impulse response of G, a condition allowing the 
error free operation of the system in the absence of noise. (Hi) The 
channel has exponentially decaying impulse response. It is this last 
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property that will allow us to describe the cumulative error by a Markov 
process. 

The input and noise sequences are regarded as samples from two 
sequences of completely independent random variables (r.v.). We as- 
sume that d k = 1 or d k = —1 with fixed but arbitrary probabilities 
p and q. The r.v.'s n k representing the noise have a fixed and, for the 
time being, arbitrary distribution function (d.f.) N(x). Typically, 
N(x) is the normal d.f., i.e., 

N(x) = —jif= [ exp (x 2 /2* 2 dx). (4) 

0"V Air J-oo 
We say that the /cth output b k is in error if b k ^ d k . 

III. EFFECTIVE NOISE 

When noise is absent from the system (n = 0, n\ = 0, • • • ) then 
b k = d k for k = 0, 1, • ■ • . Clearly, 6 = d . Suppose that bi = di for 
i = 0, • • • , k — 1. It follows from (1), (2) and (ii) that in this case 
Sk -f Ck = d k . Hence, b k = d k due to (3). The system is error-free in the 
absence of noise. To clarify the effect of noise, notice that 

fc-i 
Sh + c k = 2Z (h k -ibi + Qk-idi) 

t=0 

- „ (5) 

+ £ (hk-ibi + gk-idi) + gdk = g d k + x k , 

i = 

since A,- + Qi = 0, i ?* 0, and since bi ^ di implies bi = di , it follows 
that 

k-i *— i 

x* = 2 (/i*-«&i ■ + ff fc _,df)'= 2 S S'A-irf.-- (6) 

,=0 i=0 v 

&,=-<*,- 5,-— dj 

The cumulative effect of errors prior to time k (di ^ bi , i ^ k — 1) 
is expressed by the real number x k . 
The equation of the system, namely (3) now becomes 

b k = sgn {n k + x k + g d k }. (7) 

Hence, the output b k will be in error when 

n k + x k < -So if 4 = 1 

(8) 
nk + &* > +g a if d* = — 1. 

Thus, the effective noise in the system at time k is not n k but n k + %k • 
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Due to the assumptions concerning the independence of all input 
random variables d k , the variables n k and Xk are independent. Let the 
d.f. of x k be F k (x). Also, let p(k) = prob {bk ?* dk\. It follows from (8) 
that 

p(k) = p f N(-g - x)dF k {x) 

(9) 
+ g/(l - m+g - x))dF k (x). 

Since p, q, and N(x) are known, the problem reduces to the study of the 
sequence of r.v.'s X , Xi , • • • with d.f.'s Fo(x), Fi(x), • • • . 
It follows from (Hi) and (6) that 

fc-i 
x k +i = 2 X Qk+i-idi + 2<7i4 



t=0 



(10) 



= rxj — adk if dk ^ bk . 

where a = — 2<7i > 0. Or 

Zft+i = r.r A if d k = b k . (11) 

Thus, there are three possibilities for transitions, each of which takes 
place with probability depending on the value of Xk . Namely, 

Xk+i = rx k — a if d k = 1 ^ bk with probability pi(xk), 

Xk+i = rx k if dk = bk with probability pi(x k ), (12) 

Xk+i = rx k + a if d* = — 1 5^ 6* with probability pz(x k ). 

The transition probabihties p,,(x), n = 1,2,3 are determined from (8): 

pi(x) = pN(-g - .r) 

p 2 (x) = 1 - px(x) - p 3 (.r) (13) 

pt(x) = q[l - N(g - x)]. 

If we assume that the r.v. X is independent of all the input variables, 
then the sequence of r.v.'s X , Xi , X2 , • • • where Xk+i is related to 
Xk by the transitions characterized by (12) and (13) forms a Markov 
chain. We shall use this property, however, only to the extent of rela- 
tions (12) and (13). 

Observe the way X k +i is obtained from X* . Given the value of X k , 
the random variable X k +i may have three possible values, the values 
assumed at X k by three linear functions denned over the range of X k • 
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The choice of the actual transformation used to generate the next value 
Xi+j of the r.v. X k+l is made by performing an independent experiment 
with three possible outcomes with respective probabilities pi(X k ), 
pi(X k ) and p 3 (X k ) which, as indicated, are functions of the value X k . 

IV. ITERATIVE PROCEDURE FOR THE COMPUTATION OF ERROR PROBA- 
BILITIES 

This type of random walk is studied in Ref. 1. It is shown there that 
whenever ^ r < 1, the sequence of random variables Xi , X* , ■ ■ • has 
a limiting distribution A (x ) and also that the mean value of any con- 
tinuous function f(x), with respect to A(x), can be computed by 
iteration without actually obtaining A(x). This result will now be 
applied to our problem. 

Let Uf(x) be the function 

Uf(x) = Pl (x)f(rx - a) + Pi (x)f(rx) + p s f(rx + a) (14) 

where p„ (.r), n = 1,2,3 are given by (13). 

Also, denote by U k f(x) the Ath iterate of the transformation Uf(x), 
namely, 

U k f\x) = UiU^fix)) k = 1,2, ■•• . (15) 

Then, from Ref. 1 we have 

WmU%v) = f f(x)dA(x). (16) 

We then obtain from (9), (13), and (16) that 

lim p, = lim U k ( Pi (x) + p 3 (x)). (17) 

k k 

For the general case of I consective errors starting with the Ath out- 
put, we write 

p{k,l) = Prob (6, ^ d k , ■•■ , &*+,_, * d* +I _i) (18) 

and for the conditional probability of I consecutive errors given X k = x, 
we write 

p(k,l | x) = Prob (b k ^ d k , • • • , &,+,_! ^ d /1 . +i _ 1 | X k = x). (19) 

Clearly, 

p(k,l) = f p(k,l\x) dF k (x). (20) 
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On the other hand, it follows from (12) and (13) that 

p(k,l\x) = 2 p(ci, ••• , ei|-a;) (21) 

i— 1. ••• , I 

where 

p(e 1} ■•• ,ei\x) = p 2+El (x)p 2 +e 2 (rx + aei) • • • 

p 2+E[ (r~ 1 x + o(r ~ 2 Ei + • • • + e z _i)), 

with e, + i = 1,0,-1 according as dn+i = 1 ^ b/i+i , «L-+» = &*+i :, 
d t . +1 - = — 1 ?± bk+i . Clearly, p(k,l \ x) is independent of k. Hence, on 
account of the theorem used before, 

q(l) = \imp(k,l) = lim U k p{k,l\x) = f p(k,l\x)dA(x), (23) 

is the steady state probability of I consecutive errors. Other error pat- 
terns may be treated similarly. 

V. SUMMARY 

Observing that the cumulative error in a certain kind of data trans- 
mission system is a Markovian process we have derived an iterative 
procedure for computing the limiting probability of arbitrary error 
patterns. Using this method one can obtain numerical estimates of these 
probabilities by the aid of (23) once a computer program has been 
written to perform the iteration given in (14). Such a program is not 
presently available. 

A more general treatment of data transmission systems in which 
error reduction is achieved by quantized feedback may be found in a 
paper by W. R. Bennett on Synthesis of Active Networks. 2 
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